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lo  Introduction 

Let  X(t)  he  a real -valued  stationary  normal  process  with  a 
discrete  time  parameter  t . For  simplicityj  we  shall  assume 
EX(t)  = 0 and  denote  R(h)  = EX(t+h)x(t)  and  = R(h)/R(0)  . 

Let  us  assume  X(t)  is  observed  at  t = 1,  2,  N and  has  a 

spectral  density  f(X)  , where  A is  a frequency  parameter  and 
-1/2  ^ X ^ 1/2  . 

i.In  this  paper,  we  shall  discuss  efficient  estimation  of 
f(x)  . If  we  can  assume  X(t)  is  an  autoregressive  process  of 
order  K , K being  a known  positive  integer,  we  can  obtain, 
easily,  the  maximum  likelihood  estimate  of  f(X)  when  R is 
sufficiently  large » But  for  an  actual  process,  we  usually  do  hot 
know  the  value  of  K „ Recently,  the  estimates  obtained  by  fitting 
an  autoregressive  model  have  been  developed  and  discussed  by  many 
authors,  l.e=  , Akaike  [l],  Parzen  [8],  Gersch  and  Sharpe  [U]  and 
Jones  [7] • 

In  this  paper,  we  treat  a process  expressed  as  an  autoregressive 
process  of  infinite  order  satisfying  some  conditions o We  construct 


an  estimate  by  fitting  an  autoregressive  model  of  finite  order  K . 

In  Section  2 we  discuss  the  asymptotic  bias  of  this  estimate  for  a 
fixed  K when  W tends  to  infinity.  In  Section  3 we  consider  K 
as  a function  of  I , tending  to  infinity  as  K tends  to  infinity. 
Berk  [3]  has  discussed  a similar  situation.  He  has  shown  the  consis- 
tency and  the  asymptotic  normality  of  the  estimate  when  N tends  to 
infinity.  Although  we  shall  discuss  the  statistical  properties  of  the 
same  estimate,  the  process  under  consideration  here  satisfies  stronger 
conditions  than  his,  and  under  our  conditions  we  show  that  this 
estimate  has  a property  of  efficiency  as  N tends  to  infinity. 
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2o  An  Autoregressive  Approximation  and, Bias. 


In  the  following,  we  shall. assume,  furthermore,  X(t)  satisfies 
the  following  assximption: 

Assumption  X(t)  satisfies  the, relation 

00 

(1)  I a X(t  - k)  = C(t)  , a.  = 1 , 

k=0  ^ ° 

^here  {? ( t ) } are  mutually  independent  random  variables  each  of  which 

2 

has  the  distrihution  N(0,  o^)  and  {a^^}  are  constants  such  that 

I 1 k 

|a^J  ^ a , 0 < a , < 1/2  , 

for  every  k ^ 1 , 

In  this  case,  X(t)  has  a backward  moving  average  representation 

OO 

X(t)  - I G 5(t  - k)  , 
k=0  ^ 


where  {G  } are  constants c 
k 

As  is  shown  in  Huzil  [6],  we  have  the  following  result  under 
the  above  assumptions » 

Leimna  1.  We  have 

!Pi,I  =<  C(2a)^  and  |g^|  < {2a)^/2 
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for  any  h 


, h ^ 1 , vhere  C = l/2^(l-(2a)^)  o 
Now  we  shall  discuss  the  estimation  of  the  spectral  density 
f(X)  o We  shall  regard  X(t)  as  an  autoregressive  process  of  order 
K 5 K being  a positive  integer,  and  obtain  {a^^^ ; 1.^  k.  ^ K} 
which  minimize 


K 


X(t)  + I 


a. 


(K) 


k=l 


k 


X(t  - k) 


^ , (K)  ^ „ ^(k)  - 

Let  us  denote  a^  , which  minimizes  Q , as  a^  for 

1 ^ k _<  K „ If  X(t)  is  an  autoregressive  process  of  order  K , 

(k)  * 

the  s are  asymptotically  maximum  likelihood  estimates  of 

autoregressive  coefficients.  But  here  X(t)  is  not  an  autoregressive 

(k)  ' 

process  of  finite  order.  So  this  argument  does  not  hold.  The  a^  s 
are  the  solutions  of  the  simultaneous  eq.uation 


(2) 


I a^^^  R(k,  £)  = - R(0,  £)  , 1 ^ K , 

k=l  ^ 


where 


R(k,  i) 


N 

I X(t  - k)  X(t  - 1)  . 
t=K+l 


Using  these 


f ( A ) as  follows 


/s 

we  shall  construct  the  estimate  f(A)  of 


k 


cr^(K) 


K 


! I cos27rkX 

\k=0  ^ / 


2 

+ 


' a''^>  sln2*xj" 


where 


= 1 and 


a.(K)  = 


1 I ! ^ '2 

I x(t)  + I x(t  - k) 


W - K 


t=K+l 


k=l 


^ (k  ) 

Now  let  us  evaluate  the  bias  of  the  estimate  {^) 

sufficiently  large  and  fixed  K . ¥e  shall  denote 
a(K)  = (aj^\  4^^)'  and  = (R(0,1),  R(0,2), 

And  let  R be  the  K x k matrix  whose  (k,  £)  element  is 
Then  the  simultaneous  equation  (2)  can  be  written 


for  a 


. . . , R(0,K))’ 

/N 

R(k,  iO  . 


(3) 


R a(K)  =-R^  . 


Now  let  Q be  the  J x j matrix  whose  (k,  il)  element  is  p „ . 

/N 

Using  the  result  of  Lemma  1,  we  can  show  R(k,  Z)  converges  in  proba- 
bility to  R(k  - Z)  as  N tends  to  infinity.  Let  us  denote  the 
K X K matrix,  whose  (k,  Z)  element  is  R(k  - Z)  , as  R . Then 
for  a sufficiently  large  and  fixed  K , every  element  of  R converges 
in  probability  to  the  corresponding  element  of  R . Let  us  put 
?K  ~ R(2) R(K))  . Then  every  element  of  R^^  converges 


5 


in  probability  to  the  corresponding  element  of  R „ We  can  consider 
|r|  ^ 0 for  any  K , K ^ 1 „ Using  the  relation  (3)9  we  can  show 
the  distribution  of  /if  (a(K)  + R converges  to  the  normal  dis- 

tribution with  mean  vector  0 and  a finite  covariance  matrix.  This 
can  be  shown  by  the  same  method  as  in  Anderson  [2],  Chap.  Using 


this  result,  we  shall  evaluate  the  asymptotic  bias  of  the  estimate 
as  N — > “ . In  the  first  place,  we  shall  evaluate  the 
value  a(K)  = -R  ^R  . Let  us  put  a(K)  = (a|^^ , a^^^ , 

Then  we  have  the  following  lemma. 

Lemma  2.  We  have,  for  1.  < k < K , 


> \ ) 


,(K) 


- a^l  < C, 


K 

a 


where  is  a constant,  being  independent  of  K , 

T 

Proof.  Let  us  put  = (p^,  p^,  p^^)  for  simplicity.  Then  we 

have  a(K)  = • We  can  express,  by  using  the  result  of  Wise  [8], 


the  (k,  £)  element  u 


■^11  Sic^ 


where 


( % 

1=1 
J -i- 


^k,  £ { 


2 

1 + I a , 

j=l  ^ 


q. 


—i 

■£,k 


if  k > £ 


if  k = £ 


if  k.  < £ 


and  £j^  uniformly  bounded  for  either  k < K - or 
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£ < K - Kq  , Kq  being  a fixed  positive  integer,  when  K is 
sufficiently  large.  So  taking  into  account  of  Assumption  1,  we  have 


where  q is  a constant  and  independent  of  K . Now  we  have  the 
relation 


k=0 


by  (l).  This  can  be  written  as 


K 

I \ Pk-i  = -Pi  - I \ Pk-i  » j = 1,  2,  . 

k=l  ^ ^ J 0 k=K+l  ^ ^ 


Putting  a = (a  , a , , . . , a^)  , S = I a,  p,  , and 

, ^ ^ k=K+l  ^ 

A = (6^,  62,  , we  have 


(5) 


S'  Sk  5k  Sk  ~ 


by  using  (U).  From  this  relation,  we  obtain 


a(K)  - a = Q"^  A , 


Let  us  evaluate  6^  for  1 _<  j .5  K 
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=5  I ia,  I Jp. 


k=K+l 


^ I a C{2a) 
k=K+l 


.K+1  ^o.\K+l-J 


1 - 2a 


So  we  have 


K K+1  /o.vK+l-J 


IV  IV“r  x / ^ \ 

=^1  _<  C <1  I 2 


1 - 2a 


„ K+1  7_  V 

q C g (2g) 

(1  - 2a^)(l  - 2a) 


r,  K 

a 


for  1 ^ k ^ K 3 where  = 2qCa^/(l  - 2a^)(l  - 2a)  o We  can 
easily  find  that,  when  N tends  to  infinity,  the  mean  value  of  the 
limiting  distribution  of  /if|f^^'*(X)  - f^^^(A)|  is  zero,  where 


f^^^X) 


ot(K) 


K . 1 

^ a.  ‘ cos2TTkX 
k=0  ^ i 


( K ^ 

a.;  ^ 3ln2TFkA 
k 


low  we  have 


4(k)  - R(0)  + I R(k) 

^ k=l 


a?(K) 


I R(k)  - I (a)^'  - a^)R(k) 

k=^K+l  ^ k=l  ^ ^ 
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and 


I a^  cos2TTkx|  + I I sin2irkx| 


K 


^ cos2'n‘kX 

k=0  ^ j 


r - (i. 


sin2TTkA! 


^ cos2TTkX 

lk=K+l 


\2  / p°  \2 


J a,  sin2'[TkA 
k=K+l  ^ 


/ 


K 


+ 2 j J a.  cos27TkX  ^ a cos2iTkX 

' k=0  ^ k=K+l  ^ 


K 


+ ^ ^ \ sin2iTkX||  'I  a^  sin2TTkX| 


k=l 


K 


'V ' 

|\k=K+l 


\(  K 

2 I ^ 3s  cos2TrkX  ^ cos2TTkX] 

' k=0  ^ |\k=0  ^ ^ ' 


,(K) 


K 


K 


2 j a^  sin27rkX|(  J sin2TTkX ' 


J “ ®k^  cos2irkx| 

K /X  \2 

J ( a^  “ ^ ) sin2iTkX  1 

lk=l  ^ ^ j 


And.  also,  we  have,  for  example. 


^ a^  cos2TTkX 
k=K+l 


^ a^’*’Y(l  - a) 
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and 


K 

I ( 


(K) 


- a,  ) cos2TTkX 
k 


^ K a 


K 


Therefore , we  have 


K 


^ cos2'irkX 

k=0  ^ 


r-ij 


K 

^ a'  sin2vkX 
0 ^ 


ik=0 


12  < 0° . |2 

+ I ^ &k  sin2TrkX| 


^ Cg  K , 


where  Cg  is  a constant  being  independent  of  K „ So  we  can  show 


|f^^'(X)  - f(X)i  < K 


where  is  a constant  being  independent  of  K <.  We  obtain  the 

following  theorem. 

Theorem  1.  Let  X(t)  be  a stationary  normal  process  satis- 
fying the  Assimption  1.  Then 

|f^^^(X)  - f(X) \ < K 
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for  sufficiently  large  K , where  C 
of  K . 


is  a const antj independent 


3.  Asymptoti-C. Efficiency  of  fV'(A)  in  -a  Senseo 

In  this  section s we  shall  consider  K to  he  a function  of  N „ 

^ ^k) 

E.eeentlys  Berk  [3]  has  shown  that  f " ‘^(a)  is  consistent  and  asymp- 
totically normal  when  1 tends  tc  infinity  under  the  condition  that 
K tends  to  infinity  and  K^/N  tends  to  0 and  some  other  conditions „ 
Here  we  make  the  fcllowing  assumption « 


Assumption  2,  K is  a f^jnction  of  N such  that  K tends  to 
U ; 9 2 K 

infinity  and.  K /I  and  K a tend  to  zero  when  I tends  to 


infinity . 


This  assumption  is  stronger  than  Berk’s  condition.  We  shal3 


define  f,r(X)  as 

IX 


f^ix) 


f K 42 

y a.  cos27rkX  1 + 


1 K 

i > a,  sln2'!rk.\| 

Uii  I 


Then  we  have 


f(A)l  < Gi 

’ = a 


K 


a 


9 


where  Cj^  is  a constant-  being  independent  of  K , In  the  fo.llowing 
we  shall  consider  the  estimation  of  f (X)  instead  of  . f (X)  . We 
have 


< 


^ K 
Cg  K a 
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where  Cg  is  a , constant , independent  of  K . Now  we  have 


- fiX)^  = - f^""'(X) 


(K), 


(K)/.  A2 


+ - fg-(X) 


.(K), 


+ - fgiii)](f^iX)  - fU)] 


r^( 

l) 

- f(x)) 


fjj(X)  - f(X)j 


+ 2|f^'^^(x)  - fg(X)j  E^f^^^^CX)  - 


>^fj^(X)  - f(X)J  E^f 


(K),,s  Jk), 


+ 2(fj^(x)  - f(X))  E|f^^^(X)  - f^  ^(X) 


) • 


But  when  we  consider  the  case  in  which  N is  sufficiently  large, 
we  can  ignore  the  terms 

2^f^*-^X)  - fj^(X)J  E^f^*^^(X)  - f^^^(X)J 


and 


!^fj^(X)  - f(X)J  E^f 


2|fj^(X)  - f(X)J  E(f^^^X)  - f^^^X) 


') 


by  comparing  with  the  other  terms.  And  we  know 


[f^^^X)  - fj^iX}^  + (fg-CA)  - f(X)y 


))^fj^(X)  - f(X)j  <, 


+ 2^f^^^X)  - fj^(X))(f^(X)  - f(X))|  ^ C^(K  , 
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where  is  a constant , independent  ^of  K When  we  consider 

lim  I'  - f(X)j^  , 

we  have 

lim  I C (K  = 0 

hy  Assumption  2. " Using  the  result  of  Berk  [3],  we  can  see  that  the 
distribution  function  of  v4j/K  ^f  (A)  - f^^^(A)j 

.or  v^i/'K  ^f  (A)  - f(A)j  tends  to  the  normal  distribution  function  with 

2 2 

mean  0 and  variance  2f(A)  or  Uf(A)  corresponding  to  when 
0 < A < 1/2  or  when  A =0  oor  1/2,  respectively. 

Now  let  us  define  an  autoregressive  process  of  order  K,.  Let 
Xj^(t)  be  a stationary  normal  process  with  mean  0 and  satisfy  the 
relation 


K 

I a,  X^(t  - k)  = |(t)  , 
k=0  ^ ^ 

where  {a  } and  C(t)  are  the  same  as  those  in  (l).and  a„  = 1‘-. 

u 

¥e  Shall  put  Rj^(h)  = EXj^(t  + h)  Xj^(t)  and  = Rj^(h)/Rj^(0)  . 

Then  we  can  show  the  following  results  (,see  Huzii  [6]); 


4 .c(2a).^  , 

00 

1 -fhl  i > 

]a=l 


where  C and  are  constants,  independent  of , K , 


Let  samples  he  X^(l),  X^(2),  Xj^(]j)  , We  shall  constmict 

a^(K)  and  by  using  instead  of  X(t)  . 

Using  Xj^(t)  instead  of  X(t)  , we  can  show  the  same  results  as 
Theorems  5 and  6 in  Berk's  paper  [3].  So  we  can  obtain  that  the  dis- 
tribution function  of  vW/K  tends  to  the  normal 

p 

distribution  function  with  mean  0 and  variance  2f(X)  when 
0 < X < 1/2  or  i|f (X)^  when  X = 0 or  1/2  , if  vUk 
tends  to  0 when  W tends  to  infinity. 

■ Now,  for  Xj^(t)  , we  have  the  following  lemma. 

Lemma  3.  There  exists,  a solution  f^^^(X)  for  f„(X)  , obtained 


by  solving  the  likelihood  equations,  such  that 


4«(X)  = - fte)(X) 


converges  in  probability  to  zero  as  N tends  to  infinity. 

p 

Proof.  Let  us  consider  the  joint  estimation  of  (a^,  a^,  a^. 
Let  and  be  the  density  functions  of 


'>K> 
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(Xj^(l),  X^(2),  Xj^(l))'  and  X^^^=  (Xj^(l),  Xj^(2),  ) 

respectively.  Then  we  have 


(K) 


h-K  N-K 

(2u)  2 (a?)  ^ 


exp 


N 

^ y 
2 ^ 
20^  t=K+l 


^Xj^(t)  + a^X^(t-l)  +0..+ 


To  prove  the  assertion  of  this  lemma,  it  is  enough  to  show  that 


and 


3 logipi^^h 
3 a? 


3 logi|j(X^^^) 


for  k = l,  2, 


do  not  affect  the  solution  of  the  likelihood  equations. 
,(K) 


Let 


he  the  K x K matrix  whose  (k,£)  element  is 


JK) 

have 


(K)-l 


{K)-l 


and  q^^  ^ he  the  (k,£)  element  of  . Then  we 


^ 3 log'^(^^^) 


1 


3 a. 


(K) 

1 Pk  1 Y V (K)-l 
t=i  s=l  ’ 


ij.  l<rv*)v=> 


i6 


K 


L\p“j,  K K 


1 \k=0 


2 


' i y y ~ 


X,,(t)X,,(s) 


(K) 


1=0 


a.  p . 

J J 


(K) 


11  , |„(K) 

2 N 9 ^°®ISk 


But  we  can  show 

/ 


Vi 


1 ? V (K)-l 


f <,s~ 

t=l  S=1  ' 


= 0 ^^1 


Now  we  have,  for  1 ^ j < K-1  , 


^ C5  K , 


a M')  / yy 

8Pj  /8a^ 


< C,  , 


where  and  Cg  are  constants,  independent  of  K . So  we  can 

obtain 


n^K)-l 

® «t,s 

K-l  8 q<'^>-l  3 pV> 
r H,s 

9 a,  , 
k 

„ ^(K)  9 a, 

J=1  9 p T£ 

J 

< r 


where  is  a constant,  independent  of  t,  s and  K . Therefore 


we  can  get 


IT 


/ K K 8 ^ ' \ 

\ t=l  s-1  k I 


¥e  know 


118  , j„(K) j 1 

2 I 8 a,  i " 2 I K 

k:  r 


I L P-= 

j-O  ^ “ 


E f ^ X (+JX  ( V 

I 2 2 N £,  \,s 

\ U-  Xi~.i.  S’“X  i 


+ E 


■ lApf  , 

1 tk~0  J 1 V V t.s 


N 4'-,  A 8 a.  (s), 

t"l.  s-“l  k j 


So  we  obtain 


Combining  the  abcTe  results,  .we  can  get 


fl  3 1og4,(4'^i 


And  we  also  have 
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8 

Vji  — 

N . _2 


3 a; 


= 0 


/ 


(k  ) 

Let  R be  the  matrix  which  is  constructed  by  X^(t)  instead 
of  X(t)  in  R , and  let  us  denote 


:(K)  . 


= £ , 


where 


fi/  = ( 5/^ , 5/g , • • • , ) 


8 


II  3 a. 


(K) 


’ I 


3 log^piA^h 

*^X\. 

3 


3 logi|;(X^^^) 


I 


3 a. 


'K 


Then  we  have 


/k 


i /k  R ^11  |l£||  + /¥  ||r  ^11  ||ji|l 


where 
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Y = (y^,  y2>  • • • ’ 


iiiiP 


K 

I 


k=l 


5 


and,  for  a K x K matrix  B , Hb||  = sup  |1by||  for  1|y||  ^ 1 . We 
can  show  in  the  same  way  as  that  of  Berk  [3]  that  |[r  ^[|  is  hounded 
and  - R~^l|  converges  in  prohahility  to  zero  as  N tends 

to  infinity  (see  Berk[3]).  Also  we  can  show  /k1|^||  converges  in 
prohahility  to  zero  if  K /N  tends  to  zero  when  N tends  to  infinity. 
Therefore,  under  Assumption  2,  converges  in  prohahility 

to  zero.  As  we  have 


K 


cos2TTkX 


k=l 


< /Kiln 


(K) 


K 


1 n|^^  sin2iTkA 


k=l 


k 


<.  /K||n 


(K) 


K k 

l n.  cos2TrkX  and  E:  ^ p,  sin2iTkX  converge  in  prohahility 
k=l  k k=l  k 

to  zero  under  Assumption  2.  Furthermore, 
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Under  Assumption  2,  we  can  show  i|u^'"^||  and  fR(0  ^k)  - P.Ck)^ 

converge  in  probability  to  zero.  So  under  Assumption  2^ 

K "^(k)  \ f 

I .=1  n.  R(05k)|  converges  in  probability  to  zero. 


From  8 logili(X^^^^  )^/' 3 = 0 


for  k ~ 1 , 2 , 


. s Kj  we  have 


K 


I a R(0,J) 
j=l  J 


R(0,k)  - 20^ 


for  k^lj  2,  ...jK, 


( K ) ^ 

and  from  9 log>]j(Xj^j  ^ ~ ^ i Rave 


a'Z  = R(0,0)  + y E 

^ k=l 


2a^ 

R(0,k)  + 


8 a| 


Using  the  above  results,  we  can  obtain  the  assertion  of  this  lemma. 

2 

In  the  following,  let  us  put  s 

S(k)^.Jk) 

^ ^ 0K  -a^  , lOi 

simplicity.  ¥e  shall  denote 


^ c(K)  ^2,,.,.,.  -(k)  .s(K)  h(K)  .-n(K) 

and  0Q  -OplK),  0^  '=a^  , 0^  -a^ 


,(K) 


(6q,  6^; 


6vO 


K 


21 


and 


:(K) 


_ h{K)  -(K)  S(K)V 
- \6o  ’ 9k  j • 


Let  U^^^(X)  and  be  the  (K+l)  x (K+l)  matrices  whose 

(i,j)  elements  are  “ Vl)  (®J-1  “ ®j-l) 

E (0!^]  - 0.  \ (0^^]  - 0. 

Xj^\  x-1  i-iy  V J“ 


, respectively 5 where,  for  example. 


E (y)  means  the  mean  of  the  statistic  y "tlis  process  X(t)  . 

Let  W^^^(X)"^  and  be  the  (K+l)  x (K+l)  matrices 

XV 


whose  (i,j)  elements  are 


W 3 0 


3 logi|j(Xj^)  3 logijj(Xjj) 


i-1 


3 0.  , 

J-1 


and 


E, 


/ 3 logi(j(X^^^)  3logij^(^^^) 


X 


K 


3 0 


i-1 


3 0., 

0-1 


(K  ) 

respectively.  Let  us  denote  the  (i,j)  element  of  W (X) 
(or  W^^^Xj^))  as  w^J^X)  (or  w..  • 

Then  we  have  the  following  lemma. 

Lemma  U«  It  holds 

Ik  , 

liin  * f K ) 

Xk  ! <^K>  Xk 
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for  any  sequence  1y^}  of  real  vectors  y = 

-N/iV 

t 

such  that  y„  7^  ( 0 , 0 , . . . , 0 ) 

~ IX 

Proof.  This  result  can  he  shown  hy  the  same  method  as  the  case  when 
K is  fixed. 

3 logiJj(X^^h 

3 e. 

1 

e 

means 


e 


+ 11  f(0  0 ) ^ 

2 N atn  ^ 3 0„3  0,  3 e. 

^"“0  j 1 

0 + 

where  0 < y < 1 . Let  he  the  (K+l)  x (K+l)  matrix 

whose  (i+l,  j+l)  element  h'^  is 

1+1, j+1 

3^  logii;(X^^)) 

i 1.  Y Cfl  O') 

0 + y(0  - 0) 

(k) 

and  B'  he  the  (K+l)  x (K+l)  matrix  whose  (i+l,  j+l)  element 


MK) 

“i+l,  j+l  K 3 0.3  0. 

0 ^ 
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^i+1, j+1 


is 


^i+1, j+1 


= < 


2(a?)^ 


R(i-j ) 


i=0,  J=0 

i=0»  j i 1 i = > 

i > 1,  j > 1 • 


Then  we  can  show,  by  the  same  method  as  that  of  Berk  [3],  that 
/K  ^11  converges  in  probability  to  zero  under 

Assumption  2.  Let  us  put 


(K) 


(K)  _ 1 


3 logiJj(^^  M 


3 0, 


^ 3logi|j(X^^^ 
N 30l 


^ 3logi|j(Xj^^^) 

I Te^ 


Then  we  have 


(K)  o(K)  _ -(K)-lp(K) 


0^^'-  0 


% 


:W 


And  we  can  show 


K II  II  ~A.  - 


IX' 


r.N 


K' 


N _1_^'  ^(K)-l  (K)l 
K I 5 3 


converges  in  probability  to  zero  when  N tends  to  infinity.  So 
we  can  obtain 


2k 


<VXK  = i“Kr~ 


N-x» 


|2 

^k! 


N-i^ 


O «/ 


K 


Therefore j we  can  get 


H 


lim 


y*  ) y 

IK  !:  ^ K''  tK 


1 p(K.).(K)'\  (k)-1 

K„  1,2  ?K?  P J?  ?K 


= lim 


1 

N-^  y^  W ‘ (Xj^)  y^^  N-x>o 


IK' 


lr^?K“®<V  ?K 
IXk 


= 1 


,(K) 


by  using  Assumption  2, 

Now  we  shall  consider  the  joint  estimation  of  i.e, 

/n(K)  x(K)  X(K)\ 

1^0  ’ ^1  ’ • • • 5 / 


2 ~ (K) 

(a^,  a^,  a^),  by  ^ . Let  6 


>(K) 


be  arbitrary  joint  estimators  of  0 which  have  the  following 
properties , 

For  any  sequence  {y^}  of  real  vectors  y^^  = (yj^^  ^ ...s 

? 

such  that  7-^  ^ ( 0 s 0 5 ° • 5 0 ) 5 


(6) 


y-  g(K)  ~(K)(^)-l 
lim  - = 0 

Ik  H 


IK 
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and 


(7) 


’ ~(K)  1 g(K) 

lim  : : 0 

U^oo 


y;5®(xrS, 


K 


where  is  the  (K+l)  x (K+l)  matrix  whose  (k,S,)  element 


is  3 h 


(K) 

'k-1 


0 , h|^^  = 2(0^^]  - 0 

£-1’  k-1  \ k-1  k- 


- \-i) ' 


and  U^^^(X)  is 


the  (K+l)  X (K+l)  matrix,  the  (i,j)  element  of  which  is 

E - 0 ^(0^^.^  - 0.  . In  this  case,  we  have  (see  Cramer 

X\  i-1  i-iy \ j-1  J-1 j 

[4]) 


+ v'(b^^^  U^^^(X)"^  + U^^^(x)“^  B^^^  + B^^^  U^^^(x)"^  B^^^ 

x,Ky~  ~ ~ ^ ~ ~ 


So  we  can  obtain 


lim 

N-x» 


y;w<*^>(x)-"  Xk 
& h‘"’<x)-^  Xk 


> 1 . 


This  means 


lim 

K-HX3 


x;  y, 

& Xk 


> 1 . 
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For  our 


:(K) 


we  can  show  the  conditions  (6)  and  (T)  are 

(K) 


satisfied  under  Assumption  2.  In  fact,  analjrtic 


function  of  G = (0^,  0^, 


’ (k) 

. ) , and  we  know  that  h,  , tends 

’ k“-l 


to  zero  uniformly  in  1 ^ k ^ K+1  when  W tends  to  infinity.  If  we 

ch  ; 

(K) 


put  0 =6,,  0 , which  is  the  case  of  an  autoregressive  process 

K+ 1 KH*-  2 


of  order  K we  can  show  3 /3  0n  n converges  to  zero  as  N 

* k“l/  X.-1 

tends  to  infinity,  and  this  convergence  does  not  depend  on  the  values 


of  “ 

(K)  „ ~(K)  «(K) 


Therefore , if  we  express  h 


(K) 

k-1 


as 


h;*%'  = V‘1'  hf'--'  , where  = 0(l/u'^)  (6  > O)  , we  can 

k-1  k-1  k-1  k-1 

'^  ( K ) 

consider  an  analytic  function  of  *•'  ‘ 

if 


lim  b^^]  = 0 , 


then 


lim 


3 b. 


(K) 

k-1 


£-1 


0 


and  this  convergence  does  not  depend  on  k and  £ , because  {a^} 

(k) 

satisfies  Assumption  1 and  b'  ' tends  to  zero  uniformly  in 

il""X 

1 < k < K+1  , ¥e  have 


2T 


(K+1)2  max  (3  /a 

l<k,  a<K+l 


tends  to  zero  as  N tends  to  infinity.  Therefore,  we  can  see 


lim  — 7 ^ 

Yk  ^X)  ^ Yk 


y'  u(^)(X)-"B(^)'yK 

0 , lim  ~ ■-  ^ ^ 

Yk  U (X)  Yj^ 


In  the  following,  we  shall  consider  the  difference  between 
W^^^(X)  and  (X  ) . This  means  we  have  to  evaluate 


Jk Xk 


for  any  sequence  of  real  vectors  y^^  = (yj^^ , , . . . , y^^^ ) 

(}c)  —1  (K)  ""I 

But  for  this  purpose,  we  shall  compare  W'  '^(x)  with  WV  ‘^(X^) 

In  the  first  place,  we  shall  compare  E^^8log\Jj(X^y^90.^_^j 

^31og;jj(^)/3ej_^j  with  ^ • 

I 2 ^ ' 

Let  us  put  0 = (0Q,  0^,  0^  , ...)  = (o^»  a^5  a^,  ...)  and 
F.^(0)  = E^^3logi|;(Xj^y^30._J^3  logij;(^y3  0j_^^  . Then  we  have 


h3<?> 


5 “2k 


where  0^^  = (a^,  a^,  a^,  ...,  a^,  0,  0,  ...)  , and 
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F.  ,(0)  - F. ,(e) 

ij  ~ ij  ~ 


8 F. . (0) 
J-J  ~ 


0 = 6. 


A 3 6, 

k=K-5-l  k 

:k  ~k 


+ T 


2-2k> 


where  0 < T < 1 . By  differentiating  both  sides  of  the  equations 


N , 1 

I qTt  P-.  = < 

j=l  ^ 1 0 


1 = 1 


i # i 


with  respect  to  s we  can  obtain 


3 q.' 


3P. 


< Co  N, 


„2  -1 
a g.  . 
3^ 


9 P]^,9  Pj^ 


< Cg  1,  < h,  h'  ^ H-1 


where  Cg  and  Cg  are  constants,  independent  of  i,  j,  h,  h and 


N . And  we  have 


^ f’h  1 

00  1 

< n Y 

' Ph 

3\  1 

1=  ^9  » L \ 

^ h=l  ' 

< C, 


5 


>rhere  and 

So  we  can  get 


? 


are  constants,  independent  of 


h k and  K . 

3 § 


■3  "1 

3 g. . 

ij 

N-1  3g.^ 
y 1.1 

3 p 
^h 

^ \+l 

h=l  ^ '^h 

^ ®'K+£ 

< 

. ho  • 

for 
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where  C^q  is  a constant,  independent  of  i,  j,  K and  £ . 
And  we  also  have 


lO 

H-  1 

F-“  H 

N-1/  3^  3 p,  3 3^p, 

Y , iJ  h 

,^T\3a^.„3p,  8a  ‘ 3p  8 a o8a 
h=l  \ K+£  ^h  m h K+£  m 

"fj 

/ N-1  ^ qT^ 

Y 

® pii  * 

8q7^ 

ij 

Q. 

h=l 

\h’Sa 

^ ®TC+£^ 

8 a 
m 

^h 

8 a „ 8 a f 
K+£  m 1 

1 


where  is  a constant  independent  of  m,  £,  i,  j and  K 

Using  the  above  results,  we  can  get 


I \ 

k=K+l 


9 F.  (e) 
3 0, 


9 K 

1 "l2  ^ “ 


5k  " "(Hk) 


where  is  a constant,  independent  of  i,  j,  and  W 


So  we  can  obtain 


llw^^^X)  ^ ^11  , 

the  right  hand  side  of  which  tends  to  zero  as  N tends  to  infinity. 
Now  we  have 
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.(K) 


,(K) 

f ■vr\  / T.T  (K)/-„  \“1  ,r(K) 

f V \ -IK.(K),, 


1 lh/^^(X)ii  H II  ||¥^^^(Xj^)  II 


¥e  know 


^ " K~K 


20"  0 ....  0 


R 


So  we  can  get 


|¥ 


(K) 


< 


"23£ 

(N-K)^ 


where  is  a constant,  independent  of  N . Using  the  above  facts, 

we  can  obtain 


||W®(X) 


1-  ||¥*®^txjj)“^-  W*’'-'(X)“^||  |!W^'^*(Xj^)lf 


the  right  hand  side  of  which  converges  to  zero  as  1 tends  to  infinity. 
Therefore  we  have 


lim 

U-x» 


(„(K) 


(X)  - 
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< lim  ll¥^^^(X)  - W^^^(X^)||  = 0 
“ N-x» 


Consequently,  we  can  obtain 


(K) 


— — = M7T1  * ' , 7— T ■ \ __ 


lim  -; = lim 

N->oo  y N-^ 

«s<  'wJa. 


(yi?Kll)'?®'’'>  (xk/ii?kII) 


!k  gK 

^ ^— - , 

W-x»  MX) 


= lim 


= lim 
N-x» 


z^  w^(x)  z^ 


= 1 


where  Z^  = I^AW^W  • 

Summarizing  the  above  results,  we  have  the  following  lemma. 
Lemma  5.  Let  {y,^}  be  any  sequence  of  real  vectors 
~ (^1^^’  ^2^^  ’ ■ ' ■ ’ s^ch  that,  y^^  # (O,  0,  . . . , O)  , 

Then 


lim 

U-w 


?K 


Ik  y^^ 


= 1 . 
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t N 


Now  we  have 


where  the  last  term  converges  in  probahllity  to  zero  more  rapidly 
than  the  first  two  terms.  So  we  can  consider 


f 


(K) 


(M 


(^) 


3 f(X) 


9 f(X) 

8 a, 
k 


Let  us  put  f = n f (A)/3a|,  3f(X)/9a^,  ....  3f(A)/3a^j’  , 
and  we  shall  take  as  y^^  in  Lemma  5»  Then  the  above  dis- 

cussion means,  for  sufficiently  large  N , 


IV  -V  ~ Jv 


|j(K)  j(K) 


So,  when  N is  sufficiently  large,  we  have 
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~ (k) 

which  is  asymptotically  minimum  in  a class  of  estimates  f (X) 

of  f (X)  . Every  element  of  this  class  can  he  expressed  as 
K 


f(^^X) 


= f(x)  + 


a f 

a a? 


(®c  - 4) 


K 


at 


°ii*X 

^ ^ k=l  k 


which  satisfy  conditions  (6)  and  (T). 

Summarizing  the  above  results,  we  have  the  following  theorem. 
Theorem  2.  Let  X(t)  be  a stationary  normal  process  with  mean 
zero  and  satisfy  Assumption  1,  and  let  W and  K satisfy  Assumption  2, 
Then  we  have 


lim 

N-x» 


if(K)'  j(K) 

K ~ ~ ~ 


1 . 


In  general,  there  would  be  many  ways  to  define  the  joint 
efficiency  of  estimators  of  infinite  dimensional  unknown  parameters. 
In  the  above  discussion,  we  have  defined  the  efficiency  as  the  limit 


3h 


of  the  sequence  of  efficiencies  of  joint  estimators  of  (K-»-1) 


dimensional  unknown  parameters  (cr^,  a^  , 


K = 1,  2,  3, 


We  have  shown  f^  vA) 


o B a ^ ^ O ll 

has  the  efficiency  in 


this  sense  for  the  case  we  have  treated. 
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